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Abstract: - Machine learning approaches are increasingly successful in image-based diagnosis, disease 
prognosis, and risk assessment. There is a need to find any deviation that can be acquired in position of artificial 
femur after the log time of surgery, well in advance thereby overcome the adverse socio economic and 
psychological burden to both the patient as well as the surgeon. The aim of the study is to develop a non- 
invasive, ultrasound-based, method of diagnosing acetabular cup loosening at an early stage before any major 
bone erosion has taken place. The proposed study will build on a previously successful technique for the 
diagnosis of loosing of the femoral stem component of a THR. This paper highlights the steps like box filter 
section, mainly first order and second order, followed by key points selection, key points extraction, key point 
matching and finally finding the deviation through motion vector analysis. The data for this research has been 
collected from different hospitals in Andhra Pradesh and Tamil Nadu. 


Keywords: Machine learning, Developing Expert System, THR, Medical Image Analysis, First order and Second 
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1. Introduction alternative, more sensitive method for THR loosening 
diagnosis. Despite the fact that acetabular cups have a 

; : . ; higher revision rate over femoral components, most of the 

A detailed review of the literature provides a existing literature is stem related. Also, the limited 


better understanding of the different development stages acetabular cup studies only examined late loosening 
and trends that have characterised the history of total hip scenarios, 


replacement, leading to the reasoning of the current state of 
the art fixation methods, component types, materials 
selection, failure factors and diagnostic techniques. 
Existing literature, along with the annual reports of national 
joints registries, were utilised to follow these different 
development stages; placing them in a historical context. 


Results are achieved in two ways i.e GUI and in 
common method using MATLAB software. The proposed 
algorithm has been tested with different image databases. 
Basically the algorithm developed was confined with four 
threshold levels of patient conditions like no deviation, 


very small deviation, small deviation and high deviation of 
Image processing has been proposed as an the hip bones. 
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Test 1: Step by Step Procedure in GUI: 


Step 1: Run the GUI Implementation Program in 
MATLAB R2016; then a window is opened as shown in 
below 
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Fig. 1: GUI Implementation screen 


Step 2: In left upper corner we can observe ‘press 
for input 1’ here by clicking on this popup button, one 
window of current Directory is opened, Here we can select 
the reference image (i.e., patient X-ray just of the surgery) 
as shown in Fig. 2. 


Step 3: Same as the above step by clicking on 
‘press for input 2’ popup button we can select reference 
image 2 (1e., patient X-ray post time of the surgery) as 
shown in Fig. 3. For creating a flexible environment to the 
patients, by selecting the second reference image reaming 
all out puts appear in the GUI Window. 


Fig. 2: Selection of Reference image 1 
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Fig. 3: Selection of Reference image 2 and final out put 
images 


Step 4: Click on “Press for Patient Status” for 
knowing the status of the patient (ie. the automation 
system will display the condition of the artificial rod 
inserted in hip) in command window as shown in bellow 
figure e.g. displayed like “small deviation as observed”. 
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Fig. 4: Status of the patient 


Procedure to run the matlab Program 


Run the main Program and select two reference 
images of the patient and we can observe the status of the 
patient in command window. GUI analysis is used for end 
users (like patients and Doctors) whereas this method of 
analysis is useful for technical people and researchers 
because of more information in the form of key points, 
spectrum of reference images, information related to 
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Motion vectors etc. Some of the pictorial representations 
are discussed below. The analysis is done by comparing 
patients, one has some small deviation and another has no 
deviation in artificial Femur (artificial rod). 


Fig. 6: Patient 2 reference images 


Consider two patients say patient 1 and patient 2 
and their reference images as shown above. These images 
considered are per operative and _ postoperative 
respectively. 


Fig. 7: Key Points selection of Patient 1 
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Green circles in the above images are the key : " " " genie 
points from the patient 1. These key points are °° t J 
automatically selected using the algorithms. 400 . 


Oo 100 200 300 400 500 60C 
Fig. 9: Key Points selection of Patient Igraphical view 


The above images are the same key points as in 
Fig 7 but the location is predicted by using graphical 
method. In this, 2-d view of images locates the key points 
in special domain. Similarly for patient 2 key points are 
calculated in 


Fig. 10. 


Fig. 8: Key Points selection of Patient 2 


Similarly, for patient 2 also we calculated the key 
points. In this study, we implemented the algorithm for 
almost 200 to 300 key points from each reference image. It 
can be modified or adjust the key point depending upon our 
requirement. For example, if complex images are going to 
be used, then we can increase the number of key points. 
Also, the algorithm is designed in such a way that it 
adaptively selecting the key points. 
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Fig. 10: Key Points selection of Patient 2 graphical view 


Fig. 10a: Matching the key Points of both the reference 
images of patient 1 


After locating the key points the next procedure is 
matching the key points from one to another reference 
images. Here it can be noticed that the slope of the yellow 
lines are indicating the deviation of artificial femur. This 
slope is directly proportional to the deviation of artificial 
femur i.e. if slope is more the deviation is also more. 


Let us compare Fig. 10a and Fig. 10b, it can be 
observed that slope of the yellow lines whereas in Fig. 10 
b, lines are parallel which means that no deviation is 
identified. The same results can be expected with Motion 
vector calculation. 
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Fig. 10b: Matching the key Points of both the reference 
images of patient 2 


Fig. 11: Motion vector analysis of Patient 1 
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The above images are two different ways of 
finding the motion vectors. In Motion vector analysis 
of Patient 1, the left image, yellow lines are observed and 
in right side image, there is slight variation in color. This 
will tell us small deviation in artificial femur. 


Fig. 12: Motion vector analysis of Patient 2 


The motion vector analysis of patient 2, the 
yellow lines do not appear in the left image and no color 
change is seen in the right image. This indicates no 
deviation in artificial femur. 
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Fig. 13: Identification of key matched points Patient 1 
and patient 2 


The above diagram is identification of matched 
key points in Fig. 11 and Fig. 12 as special domain. 
Combination of two circles indicates matching of key 
points. 
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Fig. 17: Certainty in Patient 2 


The above images Fig. 16 and Fig. 17 are similar to 
linearity images but here depending up on slops deviation 
is calculated. 


The major strength of the algorithm is that it can 
identify the deviation in multiple views like motion 
vectors, special coordinates, linearity measures etc. After 
performing all processes, finally it displays results in 
command Window as shown below. 
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Fig. 18: Display the final results in command window 


2. Conclusion: 


In this paper “Machine Learning Approaches in 
Developing Expert System for Medical Image Analysis 
with respect to THR : From Detection to Diagnosis”, it has 
been clearly explained that how to develop a non-invasive, 
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ultrasound-based, method of diagnosing acetabular cup 
loosening at an early stage before any major bone erosion 
has taken place. The research work highlights the steps like 
box filter section, mainly first order and second order, 
followed by key points selection, key points extraction, key 
point matching and finally finding the deviation through 
motion vector analysis. In this it has been examined that 
the use of algorithms to monitor long term progress, 
providing a flexible environment to doctors as well as 
patients. The entire process is based on automation — by 
giving two reference images of a patient to the software 
that shows the status of artificial femur, whether aligned 
properly or not. The reference images are tested with 
multiple algorithms. The main feature of this expert system 
is that the key points are automatically identified (proposed 
method) which means that there is less probability of 
mistake, than if a human selects the key points (existing 
method). Another feature is that this system gives reliable 
outputs when compared with the existing methods. 


2.1. Future work: 


e Selection of undesired features while locating the key 
points is the complexity observed in this methodology, 
although minimized in the present study. 

e In future, the unwanted key points from the reference 
images can be avoided or removed by using adaptive 
filters. 

e Again there could be a limitation that enhancing 
reference images could result in unwanted reference 
points being enhanced. These complexities may be 
overcome by using segmentation algorithms and 
choosing the region of interest. 
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